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NUMERICAL REQUIREMENTS FOR STATISTICALLY VALID RESULTS 
IN FIELD TEST OF ACCEPTABILITY OF RATIONS — 


1. JECT NO. 30 - Field Test of Acceptability and Adequacy of U. 8S. 
Army C, K, 10-in-] and Canadian Army Mess Tin Rations. First Supplementary 
Report, 


a. Authority: Letter SPQRD 400.112 (Ration Acceptability, C and K) 
and Ath Ind. A.S.F., Uffice of the Surgeon General, SPMDO, 4 April 1944. 


b. Purpose: To determine with regard to field testing of acceptability 


of rations: 
(1) Number of men to be used as test subjects 
2) Number of meals on which data should be obtained 
3) Duration of test ‘ 
2. DISCUSSION: 


‘ae Since field tests mst be based on some form of sampling it is 
 esgential that test subjects be representative of the population to which the 
results are to be applied, and conditions in the field mst resemble as closely 
as possible the expected conditions for which the test material is designed. It | 
is understood that no test will be satisfactory unless the observers are trained 
and have absolute control of the subjects to enforce isolation from extraneous 
sources ef food and to control the activity of the subjects. 


: b. Moreover, in setting up a field test of acceptability of rebions = 
it is important to know the nuinber of men, the quantity of data and the length of 

_. time required to obtain results which have statistical validity. If such inform 

_. ation is not available in advance the test may be carried out on too few men, 
insufficient data may be gathered and the test may last too short a time; thus, 
even the most carefully collected data may give results which are not significant. ae 
On the other hand, if more than enough subjects are used for longer periods than | 
required and the data obtained are more than sufficient, waste occurs in man 
hours of test subjects and observers. 


| c, Study of the data obtained in The Field Test of Acceptability and 
Adequacy of Rations* carried out by the Armored Medical Research Laboratory at 
Topside, Colorado in the summer of 1944 permits the definition of size, time and : 
Ee petiy of data necessary for this type of field test. . 
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ee It is emphasized that aceeptability of rations wilt be iocicted ca 

a number of variables such as ambient temperature, season, rainfall, stress and 
level of work. Accordingly any inference as to adequacy or techniques of test= 
dng which may be drawn from the Topside study must be interpreted with caution . 
when applied to tests of other rations under different conditions. With these be Bs 
iénitenions in mind, however, certain useful generalization my be made, : 


3. GONOLUSIONS: 


| “In short tests (203 weeks) little accuracy is sacrificed by collect 
ing opinion " date only every third or fourth day. 


a “Dy - in longer tests (2 months) no significant accuracy ta Lest at data. _ : 
bi are ae only once a@ week, 


cae Data from the first few days may show more variations than those: 
het obtained ieee on in a 3«week test. ree 


oe cs d. Where there are only relatively few items te test, a period ‘tang 


_pesults little different from. thoes obtained when the test Compare St are used i 
—— biases as often. e 


eg e, if sddepeabidaty i of rations for weeks or months is desired, it is 
o “necessary to test the rations for the entire period but, data need be collected. 
: Re more frequently than every 6 or 7 days. 


: es a a ft. From the statistical point of view, groups of at least 2 ginteann 
bin bo men) are needed to give reliable information on the relative peceptanettee | 
‘of items in a single ration. For reasons of organization, supply, command, nariie. ‘ 
and losses from normal coal: he groups of company size (100-150 men) are more a 
Aaairalias. | 


Nae 3 c ‘The information contained in this report be made available to sgeneien 
am engaged in ration tests. | 
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es Ai ‘For purposes of this study, the following were obtained from the 
original acceptability data for EB Company on K Ration for 19 consecutive dayss 


a. Total of good, fair, and poor ratings on each item for each day 


= b. Total during 19 days of good, fair, and poor ratings on each item 
, for each man of the company. 
¢. From each of these totals was calculated the percentages of good 
-. Natings. Working with these percentages, mga of variance methods were 

~ wsed to calculate "date X item discrepance" and "men X item discrepance", each 


ie ‘2 pane food groups. 


git With these two statistics available, it is possible to estimate 


Ss the reliability of results obtained from different numbers of men for varying 


: ate of time, 


2. RESULTS 


| a, It should be made clear that the discussion to follow is concerned 
_ primarily with comparison of different items of the same general type when eaten 
Eirancently by the same men. The comparison between items to be used is the 
average percentage of "good" ratings by which one item exceeds another, If 

. only a ‘portion of the available data is used, the advantage one item has over 
 amother will not be exactly the same as when. all data are used. The probable — 
differences between results using the data for all men of E Company for nineteen > 


_.. (19). days.on the K Ration and results using data from fewer days and data from 


4 fewer nen are tabulated in Tables 1 and 2. 
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ae bs. Illustrating the use of the above sabten, | coffee and bouillon were > 
iy rated good 67% and 47% of the time respectively by E Gompany Cduring the period © 
_. . shudied, a difference of 20%. Had data from only four days been picked at ante 
for Company E for these two items, the difference between the two items would ee 
‘probably (P> 95%) fall in the range 20% 47% or 13% to 27%. The odds are better 
than even that it would fall between 17% and 23%. If data had been selected 
“from only one day, the difference would probably (P> 95%) fall in the range 5% 
tue 35%. From Table 2 it may be. seen that using the 19 days' data from 50 of the 
©4220 men would be likely to give results as far from the actual results observed — 
---ag would be the case when omiy 1 day's data on all men were used, Similarly the 
use of 2 days! data from all men would give results somewhat more accurate than 
_.would use of 80 men's data for the entire 19 days. 


coe c. Figure . on which are plotted the day by day acceptability of 3 

Ss - beverages, illustrated why little accuracy is sacrificed when only a relatively 
 -gmall proportion of the different day's data is used. After the first 3 days, the _ 

- “qpank of the items remained the same. Minor fluctuations in absolute ratings are 

ee net considered to be important. x 


ee og d. The wide differences among men (even though in the same company) in 
Fe Onde opinions of the relative merits of different items are illustrated in 
ables 3 and 4--Table 3 shows the ratings given by three different men to three 
_ @ifferent beverages, The discrepancies among them are almost identical with 
hs neice for all men of the company. 


: a TABLE 3 | | nae 
eee Percentages of Time Different Men Rated Different Beverages Good <5 


j 2 os pas Table 4 s)lustretes” ‘the wide difference of aeikta ete Company — 
cae - mates as to the rank of Bart of 3 beverages. 


TABLE 4 


Percentage of aa ‘thanking Each of Three Ditnrices 
ie gerne and Third Choice 
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| % ddiuatrete further the aif tevences which may complicate aveepieta inne ee 

3 of ‘acceptability questionnaires, some of the differences among platoons inthe 
game mane acid and among companies: are presented in Tables 5 and 6; A, Ces 
TABLE 5 


| — Percentage of Good Ratings of Confections by Different 
Platoons in the Same Company — 
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~ : : The. platoon by item discrepance is statistically significant. 


Differences Among Companies in Acceptability Scores* Given 
Experimental C Ration Item Groups 


Meats 


Cereals 2.80 

Beverages 207k 

Confections 2-93 

f Pave Biscuits 266k, 
y Sead # Score calculated by ‘the wiiation 3 (No. of good) $2 (No. of 


Vege esc: > Bedy) +1 (No, of Foor) divided by the total number of ratings. 


4 


The results of this study inatcate that the : aest promising way in 
whieh +6 “reduce the labor of obtaining ration acceptability information is ott ed 
“through reducing the number of days of data collection rather than through re= Mia 

eo hag the number of test subjects. ie ee 


oe es o£, If information regarding the relative acceptability of items for a 
A short period of time (say 3 weeks) is desired, theré appears to be little value 
«Zn obtaining data more often than every 3 or h days. If one suspects that thee gts 
“will be a trend in acceptability upwards or downwards during.a period as short as 
_. . $eweeks men should be kept on the ration for that length of time. Collection a 
_ \ os @f data only on.each third or fourth day would give results very little cet orene 
ge Sein date collected daily. : a - 


boy he cbueee ge if information. is ‘desired on y donk time acceptability, the a. apparent. 
Pe oe way” to. obtain. it is to feed the ration for a long time. Extrapolation of results 
a from a short test Ais a senaeress, Lies oak Ifa Long test - fees even B Aenet 
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iba rvede between data polleckien days would be possible. (Five to 7 days 


“2 should give valid results). 


he In contrast to the small variability from day to day in the relative 


acceptability of ration items, different men in the same company differ widely 2 


in their opinions of the relative desirability of different items, For example, 
the odds are even that any 2 men of arcompany picked at random will differ HS ee 
their opinions as to how much better one item is than another by nearly 30%. | 
This being the case, the use of too small numbers of men in evaluating a ration 


bee is likely to result in data which are not representative of the population in- 


which one is interested, 


i. Farthediore, the fact that platoons differ within companies and that 
companies themselves differ in their opinions of the relative merits of rations 
and ration items indicates that great care must be exercised in selecting test 
. personnel representative of the larger group for whose feeding the ration is 


~ proposed, 


af j. If it is desired to compare different rations, the test plan should — 

be set up with at least 2 platoons or better a company for each ration; and in 

which groups are systematically rotated from one ration to another to smooth ~ 

_ the differences among groups, On the basis of this study, it would appear that 
an entire company, or at the least two platoons, are needed to test ration items 

adequately for acceptability. 
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